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^ Abstract 

U 

M^ Let cr be a permutation of {0, . . . , n}. We consider the Markov chain X which jumps from 

■^ fc / 0, n to a{k + 1) or a{k — 1), equaUy hkely. When X is at it jumps to either cr(0) or a{l) 

■—L. equally likely, and when X is at n it jumps to either a{n) or a{n — 1), equally likely. We show 

(SJ that the identity permutation maximizes the expected hitting time of n, when the walk starts 

at 0. More generally, we prove that the hitting time of a random walk on a strongly connected 
L^' d-directed graph is maximized when the graph is the line [0, n] n Z with d—2 self-loops at every 

J^ vertex and d— 1 self- loops at and n. 
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^H 1 Introduction 
> 

(^ Let 0" be a permutation of {0, . . . ,n} and {^i)i be i.i.d. uniform random variables in { — 1, 1}. We 

l> define the process X'^ by setting X^ = and X^^-^ = cr(Xf + ^t+i) if X[ / 0,n. Otherwise, if 

^"i X^ = 0, then X^j^-^ is uniformly random in the set {cr(0), cr(l)} and if X^ = n, then it is uniformly 

^^ random in the set {a{n), a{n — 1)} . 

^^ In this paper we address the question of maximizing the hitting time of n starting from by the 

• . process X"^ . In particular we show that the identity permutation gives the slowest hitting time of n 

. 5^ starting from 0, i.e. in this case X"^ is a simple random walk on {0, . . . , n} with a self-loop at and 

/^ at n. 



Theorem 1.1. Let a be a permutation of {0, . . . ,n} and X" the Markov chain defined above. If 
Tn = inf{t > : Xf = n}, then 

Eo[rn] <n'^ + n. 

Equality is achieved if and only if a is the identity permutation. 

As we explain in Section [Sj the process X^ can be viewed as a random walk on a strongly connected 
graph where every vertex has outdegree and indegree equal to 2. In Section [2] we prove a more 



general result (Theorem 1.4) concerning directed graphs in which every vertex has indegree equal 
to the outdegree equal to d. Then in Section [3] we give the proof of Theorem |1.1| by applying 
Theorem II .41 for d = 2. 
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Definition 1.2. Let d > 2 and n S N. We define L{d,n) to be tlie grapli on [0,n] n Z with tfie 

following properties: 

1)0 and n have d — 1 self loops each and all other vertices have d — 2 self loops 

2) for every k ^ and i ^ n there is a directed edge from A; to fc — 1 and from i to i + 1. 
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Figure 1: The graph L{d,n) 



Definition 1.3. A directed graph G is connected il the graph G' obtained by removing the directions 
from the edges is connected. A directed graph G is strongly connected if for every pair of vertices x, y 
there is a directed path from x to y. We denote this hy x -^ y. We denote by V{G) the vertex 
set of a graph G and we write outdeg(3(2;) and indeg(j(x) for the outdegree and indegree of the 
vertex x in the graph G. 

Theorem 1.4. Let G be a directed graph on n + 1 vertices which is strongly connected and such 
that the indegree of every vertex is equal to its outdegree and equal to d > 2 (allowing (multiple) 
self-loops and multiple edges). Then if Tx is the first hitting time of x by a simple random walk on 
G, then for all x and y we have 

^x[Ty] < -n(n + l). 
Equality is achieved if and only if G is isomorphic to L{d,n). 

To date, much of the work on Markov chains has focused on random walks on undirected graphs. 
Random walks on directed graphs have received relatively less attention and there are many in- 
teresting unexplored questions in this area. In particular, the first known bounds for mixing time 
parameters of a simple random walk on a directed graph have been studied by Fill in [4J and for 
the Eulerian case by Montenegro in [5]. 

Although the methods and ideas of the proofs are completely different, at a philosophical level 
the problem of maximizing the hitting time of {0, n} by X°" over all permutations a is related 
to applications of rearrangement inequalities as in p] and [6] . We state a related result that was 
proved by Aizenman and Simon in ^J : among all open sets of equal area, the ball maximizes the 
exit time by a Brownian motion. An analogous statement for a discrete lazy random walk is proved 
in [71. 



2 Directed graphs 



In this section we give the proof of Theorem 1.4 We start by stating a standard result about 



Eulerian graphs whose proof can be found in the discussion following Theorem 12 in [2] . We then 
state and prove some preliminary results about directed graphs that will be used in the proof. 



Lemma 2.1. Let G he a directed graph with the property that the outdegree of every vertex equals 
its indegree. If G is connected, then it is strongly connected. 

Lemma 2.2. Let G be a finite strongly connected graph. Suppose there exists a vertex i such that 
indegQ{i) > outdegQ{i) and for all x ^ i we have indegQ{x) < outdegQ{x) . If t^ is the first return 
time to i by a simple random walk on G, then 



H^t] < 



J2x outdegQ{x) + outdegQ^i) — indegQ{i) 
outdegQ{i) 



Proof. Since in every directed graph the sum of the outdegrees must equal the sum of the indegrees, 
we get 



indegG(i) - outdegcl?) = ^(outdegG'(x) - indegG'(2;)). 



(2.1) 



Consider the set A = {x : indeg(j(x) < outdeg(j(x)}. We start adding fictitious edges from i to all 
vertices j G A until the total number of edges that come into j equals outdegQ(j). We call the new 
graph G' as shown in Figure [2J 




Figure 2: The graph G' , where the red dashed lines are the new fictitious edges and the black lines 
are edges in the original graph. 



In view of (2.1) in the new graph indeg(^(i) = mdegQ/{i) = outdegQ/{i). Also mdegQ/{x) = 
outdeg(^/(x) = outdeg(j(x) for all x G V{G) \{i}, and hence if vr denotes the stationary distribution 
of a simple random walk on the directed graph G' , we obtain 



vr u 



indegaii) 



J2xj^i outdegG(x) + indegcCO ' 



Since the directed graph G' is strongly connected, the simple random walk on G' is irreducible, and 
hence the return time to i in the graph G' is l/7r(i), i.e., 

Ex^iOutdegG(x) + indegG(i) _ outdeg^W^ r +n ^^ (indegcKj) - indegG(j))g ^^ ^ tb^ r n 



indegG(i) 



outdegg./ (i) 



jGA 



outdegQi{i) 



where tj is the hitting time of vertex i in G' . However, since outdeg(^/(i) = indeg(^(i) and IEj[rj] > 1 
for ah j 7^ i by rearranging we get 



H^t] < 



J2x outdegG.(a;) + outdegGr(i) - mdegdi) 



outdegG.(i) 



and this concludes the proof of the lemma. 



D 



In the next results, we will usually need to construct new graphs that come from a directed graph 
G with a distinguished vertex u. In order to avoid repetitions of the same construction in many of 
the statements and proofs we now give the definition of the new graph. 

Definition 2.3. Let G be a directed graph and u G ViG) a distinguished vertex. We write /„ 
for the set of vertices having a directed edge to u. For each i S /«, we construct the graph Gi as 
follows: first we remove u from the graph G together with all the edges incident to it and then we 
connect every j G /„ \ {i} to i using multiple edges if there are multiple edges in the original graph 
between j and u so that outdeg,^. (j) = outdeg(j(j). We define Ai = {x : i -^ x in Gi} and the 
graph {Ai,Ei) to be the subset of Gi induced by Ai. We write indeg^. (x) and outdeg^. (x) for the 
indegree and outdegree oi x £ Ai in the graph {Ai, Ei). 




Figure 3: The graph {Ai,Ei), where the red dashed lines represent the new edges and the black 
lines are edges in the original graph. 



Lemma 2.4. Let G he a strongly connected graph such that indegQ^x) = outdegQ^x) for all x. Let 
u he a distinguished vertex of G. Fix i and suppose that Ai ^ 0. The graph {Ai,Ei) is strongly 
connected and contains i. Furthermore if ri is the number of directed edges from i to u in the graph 
G, then 

outdegj^.{x) = outdegQ{x) and indegj^^{x) < indegQ{x), for all x £ Ai\ {i} 
outdegj^^{i) = outdegQ{i) — r^ and indegj^.{i) > outdeg j^.{i) . 



Proof. First we establish that if x E Ai, then there is a directed path from x to i using only 
vertices of Ai. Indeed, in the original graph G, there is a path from x to i, since G was assumed 
to be strongly connected. If this path does not use the vertex u, then we have nothing to show. 
If it does, then if it uses the edge (i,n), then we are done again. If not, then it uses an edge of 
the form {i£,u), in which case since ig S /« is connected to i by at least one edge in Gi, it follows 
that X — )• i. Clearly by the definition of the set Ai all the vertices in the path from x to i are in 
Ai. Furthermore, i £ Ai, since its neighbours are in Ai by definition. Since all vertices in Ai are 
connected to i in both directions, it follows that the graph defined by Ai is strongly connected. 

Again by definition it follows that all the neighbours of x £ Ai \ {i} are in Ai. Hence if x G 
Ai \ {i} we have outdegy^. (x) = outdegg(x) and outdeg^. (i) = outdeg(j(i) — r,. th we deduce that 
indeg^,(x) < indegg(x) for all x G Ai\ {i}. Using these inequalities together with the fact that 



^ (outdeg^^ (x) - indeg^^ (x)) = indeg^^ {i) - outdeg^^ 

:4.\ /A 



xeAi\{i} 



:W 



we deduce that indeg^^(i) > outdeg^. (i) and this finishes the proof of the lemma. 



D 



Lemma 2.5. Let G be a strongly connected graph on n vertices such that for all vertices x it 
satisfies indegQ^x) = outdegQ{x) = d. We fix a vertex u and write /„ for the set of vertices that 
have an edge leading to u. If ^i is a probability measure supported on /„ and r„ is the first hitting 
time of u by a simple random walk on G, then 



E^.[r„: 



< nd — d. 



Proof. Let X be a simple random walk on G with Xq ~ fi and lu = {ii, ■ ■ ■ , ik} with k < d, since 
there could be multiple edges. 

For any i G /„ we write rj for the number of directed edges from i to u. Every time the random 
walk is at a vertex z S /« it has probability ri/d of jumping directly to u. If it does not jump, then 
it starts walking in the remaining graph until the first time that it hits /„ again. Define {^j^ )k to 
be the lengths of i.i.d. "excursions" starting from i £ lu until the first time that they come back to 
the set lu without hitting u independently for different i. 

It is clear that adding directed edges from every £ E /„ \ {i} to i cannot affect .^} . H ence we can 
upper bound ^^ by the return time to i in the graph (Ai, Ei) constructed in Definition 
graph we have outdeg^. (i) = d — ri. 



2.3 



In this 



Lemma 2.4 gives that Ai satisfies the assumptions of Lemma 2.2 Therefore since \Ai\ < n and 
Tj > 1 for all i £ lu '^e deduce 

dn — d — 1 



Ki 



?1 



(i) 



< 



d 



(2.2) 



We now define independent collections of random variables 



D(n) R(n) 

d(*2) n(«2) 



i.i.d. Birijd) 
i.i.d. Binjd) 






i.i.d. B{ri^/d), 
where B{p) stands for the Bernoulli distribution of parameter p. 



We can realize the random walk X until the first time that it hits u in the following way: at time 



if 5 



I ° = 1, then it jumps directly to u. Otherwise it makes an "excursion" of length ^i ° until 
the first time that it comes back to I^. We define ^(1) = Xq and Ci = i\ ° ■ Inductively we define 



fc+i 



l{k + l) = X^^ and Cfc+i = E^. 



W«)) 



s=l 

In words, Cfc is the time which has passed until the end of the /c-th excursion and l!.{k) is the position 
of the random walk at the end of the (/c — l)-th excursion. At the end of the (A; — l)-th "excursion" X 
hits u directly with probability r^if,\/d. If it does not, thene we attach another excursion of length 

Ck ^'^^ ^^ continue in the same way until the first time that X hits u. We finally define 

T = min{s : S^^^^^^ = 1}, 

i.e. T is the number of used Bernoulli random variables until the first time that a Bernoulli is equal 
to 1. Hence we can now write 



E^[rJ = E[Ct-i] + 1. 



(2.3) 



By the definition of C, we get 

VT-l 



E[Ct- 



E 



E«, 



(£(fc)) 
k 



.k=l 



^E[ep)i(r > k)] = ^E[E[ep)i(r > k) 



fc=i 



fc=i 



{d-ri(i)) {d-ri,(^k)) 



d 



d 



E 



Am) 



k=l 



iKJ)h 



Am) 
^k ' 



iKj))j<k 

(2.4) 



j<k 



Using (2.2) we now immediately get that 



m)) 



j<k 



< 



dn — d — 1 

d-ri(k) 



Mk)) 



since ^^ is the length of an "excursion" started from the vertex i.{k). Hence plugging that 



into (2.4) and using that r, > 1 for all i we get 



IE[Ct-i] <^{dn-d-l 



{d-l 



vfc-l 



fc=l 



d^ 



dn — d — 1 . 



This together with (2.3) gives 



E|i [tu] < dn- d 
and this concludes the proof of the lemma. 
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We are now ready to give the proof of Theorem 1.4 



Proof of Theorem II. 4i Note that if G is isomorphic to L{d, n), then 



maxEj^ir^,] = —n(n + 1). 
x:,y 2 



We prove the strict inequality by induction on n. For n = 1 it is trivially true. Suppose that for 
any strongly connected graph on n + 1 vertices with indeg(x) = outdeg(j;) = d for all x and which 
is not isomorphic to L{d, n) we have 

maxE2^[T^] < —n{n + 1). 
x,y 2 

Let G' be a strongly connected graph on n + 2 vertices with indeg^j/ (x) = outdeg^/ (x) = d for all x 
which is not isomorphic to L{d, n + 1). We will show that for all x and y 

]Ex[Tj,]<^(n + l)(n + 2). (2.5) 

Let I = {zi, . . . , Zfc} be the vertices such that there is a directed edge from every in to y. Note that 
k < d, since we are allowing multiple edges and self-loops. 

Clearly we can write 

E^[Ty]=E,4Tj]+E^,[Ty], (2.6) 

where tj is the first hitting time of the set I by the simple random walk on G' and /u is a measure 
on / with 

fi{ii) = F^{Xrj = it) . 



By Lemma 2.5 we immediately obtain 

E^[Ty]<nd + d. (2.7) 



If X G /, then (2.7) finishes the proof. So from now on we assume that x ^ I. Since in order to 
hit y we must first hit the set I, we are going to look at the graph not containing the vertex y and 
the edges incident to it. Clearly adding edges coming out of points of I is not going to change the 
first hitting time of the set / starting from x. We now explain how we add extra edges coming out 
of the set / in order to apply the induction hypothesis to a graph of smaller size. 

Let J = {ji, . . . ,jm} be the vertices such that there is a directed edge from y to every J£. Note 
that as above m < d. Removing the vertex y and its incident edges removes the edges from y to 
vertices in J as well as edges from vertices in / to y. Therefore in order to keep the in and out 
degrees of all the vertices in the new graph (obtained by removing y) equal to d we shall add edges 
going from / to J. We describe how to achieve this whilst keeping the graph connected. 

Let Ji be the subset of J containing only those vertices jr which in graph G' have an undirected 
path from jV to ii that does not visit vertex y. 

Suppose we have defined the sets Ji, . . . , Ji. We next define J^+i to be the set of jr € J \ Us<iJs 
which in G' have an undirected path from jr to i^+i that does not visit vertex y. 

Note that some of the sets Jg could be empty, nevertheless since the original graph is connected we 
have 

\Jjr = J. 

r 

We now consider only the non-empty subsets Jr, which we index by si, . . . , s^ so that if j S Js^^, 
then it is connected to ig^ ■ We then connect isi to an element of Js2 (chosen arbitrarily) and is2 to 
an element of J^g and so on. Finally we connect ig^ to an element of J^j . 

At the end of this procedure, we add edges between I and J so that in the resulting graph every 
vertex has indegree equal to outdegree equal to d. This is possible, since the indegree of y is equal 
to its outdegree. We call the resulting graph G" as shown in Figure |4J 




Figure 4: The graph G" , where the red dashed Hnes are the new edges and the black hnes are edges 
in the original graph G' . 



We now claim that this new graph G" is connected. Indeed, all the vertices in J^ are connected to 
each other by the definition of the set Jr. Let ji G Jg^, and J2 G Jsk+i- Then since we connect ji 
to isk+i it follows that ji is connected to J2- Furthermore, as each z G / is connected to at least 
one j G J, the graph is connected. By Lemma 2.1 it follows that it is strongly connected (since we 
kept the in and out degrees at every vertex equal to d) on n + 1 vertices. 

If the graph G" is not isomorphic to L{d,n), then by the induction hypothesis we get 

^x[ti] < -n(n + l) 



and this together with (2.6) and (2.7) finishes the proof of i2.5h in this case. If G" is isomorphic 



to L{d,n) (in which case we identify these two graphs), then we shall consider two separate cases: 
\I\ = 1 and |/| > 2. We start with the case |/| = 1. If / = {ii} and from ii the only vertex we can 
reach in one step is y in G' , then 



E,^[Ty]<d. 



{21 



Since the graph G" is a strongly connected graph on n + 1 vertices with in and out degree of every 
vertex equal to d, from the induction hypothesis it follows that 

Ex[-r/]< -n(n+l). 



Hence this together with (2.6) and (2.8) gives that in this case 



^x[Ty\ <-(n + l)(n + 2). 

If ii has another out-neighbour h ^ y in G' , then zi cannot be an endpoint of the line, so the hitting 
time of ii will be bounded by the maximum hitting time on L{d, m) for m <n — l and thus we get 

lExhJ < -n{n+l). 



This finishes the proof of (2.5) in the case |/| = 1. It remains to show that if |/| > 2, then 



^x[ti] < -n(n + l). 



Since the subgraph G" is isomorphic to L{d, n), then the vertex i* of / closest to x satisfies 

Exh*] < -n{n+l). 



This together with (2.7) finishes the proof of the theorem. D 



3 Permutation walk 

Lemma 3.1. Let a he a permutation of {0, . . . , n}. Then the Markov chain X" is irreducible. 

Proof. We first observe that the Markov chain can be represented as a random walk on a directed 
graph such that the outdegree of every vertex is equal to its indegree (note that we also count 
self- loops). Hence if we establish that ignoring orientations, the underlying graph is connected, 



then we can apply Lemma 2.1 and finish the proof. 



It is easy to see that the undirected graph is connected. Indeed, from the description of the process, 
all the odd points are connected to each other and all the even points are connected to each other, 
since k — 1 and A; + 1 both lead to a{k). Since and 1 both lead to o"(0), it follows that the two 
sets (odd and even points) are connected, and hence this concludes the proof. D 



Proof of Theorem II. ll As we already noted in the proof of Lemma 3.1 above, the Markov 



chain X'^ can be viewed as a random walk on a directed graph such that the in and out degree 



of every vertex is equal to 2. Furthermore, from Lemma 3.1 we know that this graph is strongly 
connected. 



Hence applying Theorem 1.4 shows that 



From Theorem 1.4 we get that equality is achieved only if the resulting graph is isomorphic to L(2, n) 
and (t(0) = and cr{n) = n. It thus follows that a has to be the identity permutation and this 
finishes the proof. D 

Remark 3.2. We note that the statement of Theorem |1 . 1| remains true if we change the Markov 
chain as follows: whenever at k the next step is either (T{k) + 1 or cr{k) — 1 equally likely. Indeed, 
it is easy to see that this Markov chain is again a simple random walk on a 2 directed graph which 



is strongly connected, and hence Theorem 1.4 applies 



4 Open problem 

The following problem was communicated to us by Yuval Peres, but we could not trace its origins. 
We state it here: 

Open problem: Let o" be a permutation of {— n, ...,n}. Let (^j)j be i.i.d. taking values in 
{—1, 1} equally likely and set Xq = and X^_^^ = cr{Xf + .^t+i) if X[ ^ n, — n, otherwise X^__^^^ 
takes values in {a{n),a{n — 1)} or {a{—n),a{—n + 1)} respectively equally likely. Show that 
the identity permutation maximizes Eq [''"{-n,n}] ) where Tr „ „} is the first hitting time of the set 
{-n,n} by X". 



Remark 4.1. In contrast to Theorem |1.1| where equaUty is achieved only when a is the identity 
permutation, we note that for this problem this is no longer the case. In other words, the identity is 
not the unique permutation that maximizes Eq [t|_„ ,1}] . Indeed, \ia{x) = —x for all x G [— n, n]nZ, 
then Eq [''"{-n,n}] = f^"^- Also, it is easy to check that if a is the permutation that transposes and 1, 
then it also achieves the same upper bound. Nevertheless, if a only transposes k with A; + 1, then 

r . 2n-3-2/c 

Eo \T{-n,n}\ = n h n{n - 2) 

for all < /c 7^ n — 1, n. 

By arguing in a similar way as in the proof of Lemma |3.1[ it is easy to see that the process X'^ 
can be viewed as a random walk on a 2 directed graph which is strongly connected. Hence by 



Theorem 1.4 we immediately get that for any permutation a 

Eo [T{-n,n}] < 4n2 + 6n + 2. 
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